==============================================================
Guild: wafer.space Community
Channel: 𐦂𖨆𐀪𖠋 - Friends / fpgas-online
Topic: Channel for continued development of https://fpgas.online
After: 2026-09-30 11:59 p.m.
Before: 2026-11-01 12:00 a.m.
==============================================================

[2026-10-04 5:44 a.m.] carlfk


{Attachments}
2026-10_media/rn_image_picker_lib_temp_9b0219ed-b20e-445-FF8EB.jpg


[2026-10-04 5:46 a.m.] carlfk
3Bv1.2 ?? has no PoE header


[2026-10-04 5:50 a.m.] carlfk


{Attachments}
2026-10_media/rn_image_picker_lib_temp_e43102d6-96c3-48c-48355.jpg


[2026-10-04 5:50 a.m.] carlfk
PoE hat powreed v4 setup screen


[2026-10-04 9:32 a.m.] carlfk
something is going on.  net/nfs boot, pi4 sends the bitstream to the arty then reboots a minute later


[2026-10-04 9:33 a.m.] carlfk
same pi with an sd card, brings up a gui desktop, no reboot


[2026-10-04 9:34 a.m.] carlfk
I have trouble believing te arty is drawing so much power the pi reboots


[2026-10-04 11:28 p.m.] mithro_
@carlfk - Could you check on the Acorns in the Compute Blade?


[2026-10-04 11:30 p.m.] carlfk
They are still there 🙂


[2026-10-04 11:31 p.m.] carlfk
they are wired to the switch, I could probably figure out which ports by turning them all on


[2026-10-04 11:32 p.m.] carlfk
I'll be at ps1 in.. 18 hours ish.


[2026-10-04 11:32 p.m.] carlfk
what sort of checking were you looking for?


[2026-10-04 11:34 p.m.] mithro_
```
  From outside, at 10:01 today
  - The index lists nine boards: pi2, pi3, pi5, pi7, pi9, pi11, pi13, pi21 and pi23. None is an Acorn host.
  - The Compute Blade hosts have no page: pi14.html, pi16.html, pi18.html and pi20.html all answer 404.
  - ps1 has no fleet registry page (/fleet/ answers 404), so no boot-check result is visible from outside.

  Last direct look, 31 August (from my notes, not re-checked)
  ┌──────┬──────────┬────────────────────────────────────────────────┐
  │ Host │  Module  │                  On PCIe then                  │
  ├──────┼──────────┼────────────────────────────────────────────────┤
  │ pi14 │ CM4      │ Acorn CLE-101, PCI ID 1e24:0101                │
  ├──────┼──────────┼────────────────────────────────────────────────┤
  │ pi16 │ CM5 Lite │ Acorn CLE-101, PCI ID 1e24:0101                │
  ├──────┼──────────┼────────────────────────────────────────────────┤
  │ pi18 │ CM4      │ nothing, M.2 slot empty                        │
  ├──────┼──────────┼────────────────────────────────────────────────┤
  │ pi20 │ CM5 Lite │ a Xilinx card showing the generic ID 10ee:7011 │
  └──────┴──────────┴────────────────────────────────────────────────┘

  All four blades were up that day.

  Not known
  - Whether those blades are powered today, what design is on the cards, or whether our boot check has ever run there.
```


[2026-10-04 11:36 p.m.] carlfk
nice - I can power on those 4 ports


[2026-10-04 11:38 p.m.] carlfk
@Tim 'mithro' Ansell all 4 were off.  I just powered them all on.


[2026-10-04 11:39 p.m.] mithro_
@carlfk - I'll have some follow up instructions on how to "verify" they are wired up correctly.


[2026-10-04 11:43 p.m.] carlfk
@Tim 'mithro' Ansell well.. I see 2 of them booting linux:


[2026-10-04 11:43 p.m.] carlfk
('10.21.0.116', 6665) [    9.991035] audit: type=1130 audit(1791157300.039:11): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=modprobe@fuse comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'


[2026-10-04 11:44 p.m.] carlfk
that same IP seems to have just rebooted


[2026-10-04 11:44 p.m.] carlfk
i am wondering if some startup script is causing the reboot


[2026-10-04 11:45 p.m.] carlfk
for sure I had a hack because something (camera process I think) didn't have a hostname (needed to tell nginx where video data was coming from )


[2026-10-04 11:46 p.m.] carlfk
managing hostname has been ... tricky.


[2026-10-05 12:00 a.m.] carlfk
sigh.  somehow 16 has become stable


[2026-10-05 12:00 a.m.] carlfk
pi@pi16:~ $ uptime 
 00:59:28 up 6 min,  1 user,  load average: 1.42, 1.10, 0.53


[2026-10-05 12:00 a.m.] carlfk
120 is still rebooting


[2026-10-05 12:01 a.m.] carlfk
120 = 10.21.0.120 = port 20


[2026-10-05 12:16 a.m.] mithro_
@carlfk - https://docs.fpgas.online/en/latest/verify/fpgas-verify.html#installing


[2026-10-05 12:48 a.m.] carlfk
systemctl cat fpgas-verify


[2026-10-05 12:48 a.m.] carlfk
EnvironmentFile=-/etc/default/fpgas-verify


[2026-10-05 12:48 a.m.] carlfk
cat: /etc/default/fpgas-verify: No such file or directory


[2026-10-05 12:48 a.m.] carlfk
that seems wrong


[2026-10-05 12:49 a.m.] carlfk
but it might not matter


[2026-10-05 12:49 a.m.] carlfk
ExecStart=/usr/bin/fpgas-verify $FPGAS_VERIFY_ARGS


[2026-10-05 12:54 a.m.] carlfk
@Tim 'mithro' Ansell other than 'fail' I'm not sure how to read this


[2026-10-05 12:55 a.m.] carlfk
ssh -p 11622 pi@ps1.fpgas.online


[2026-10-05 2:28 a.m.] carlfk
welp, I took the reboot out whenever this happened https://github.com/CarlFK/pici/commit/383b11a43ad8f6ff5c3dde772c69eacdec9a486c

{Embed}
https://github.com/CarlFK/pici/commit/383b11a43ad8f6ff5c3dde772c69eacdec9a486c
re-run dhclient instead of rebooting.  might be better? · CarlFK/p...
2026-10_media/383b11a43ad8f6ff5c3dde772c69eacdec9a486c-1B4A3


[2026-10-05 2:56 a.m.] carlfk
gah.  20 finely deiced not to reboot


[2026-10-05 2:56 a.m.] carlfk
pi@pi20:~ $ uptime
 03:55:35 up  2:21,  1 user,  load average: 1.00, 1.01, 1.07


[2026-10-05 4:09 a.m.] carlfk
CM4  the 4 is for Pi v4 , right?


[2026-10-05 4:11 a.m.] mithro_
@carlfk - I'm getting a bunch of stuff for you for these boards.


[2026-10-05 4:13 a.m.] carlfk
Oct 04 22:46:59 kas1 dnsmasq-tftp[1228]: sent /srv/tftp/4e45f174/kernel8.img to 10.21.0.118


[2026-10-05 4:14 a.m.] carlfk
tftp sends to the 2 CM4x and they don't seem to do anything after that


[2026-10-05 4:14 a.m.] carlfk
the 2 CM5s start sending kernel boot messages


[2026-10-05 7:29 p.m.] carlfk
omg - 14 and 18 just booted all the way!


[2026-10-05 7:29 p.m.] carlfk
and 16 went to sleep.


[2026-10-05 7:30 p.m.] carlfk
@Tim 'mithro' Ansell these boards (or maybe just CM?) are super weird


[2026-10-05 7:55 p.m.] carlfk
14 18 20 up.  16 boot looping


[2026-10-05 8:15 p.m.] carlfk
16 woke uj.  all 4 are up.  I don't understand.


[2026-10-05 9:42 p.m.] mithro_
@carlfk - I think Claude might have fixed it.....


[2026-10-05 9:59 p.m.] carlfk
Claude fixed my server?


[2026-10-05 10:56 p.m.] mithro_
@carlfk - I'm not 100% happy with the output but this is what it wrote for you at the moment - https://ten64.welland.mithis.com/~tim/ps1-compute-blades-draft9-Letter.pdf


[2026-10-05 11:10 p.m.] carlfk
what did claud fix?


[2026-10-07 7:21 p.m.] carlfk
arg.  none of the pi are staying booted.


[2026-10-07 7:21 p.m.] carlfk
nmap shows 22 open for a second, then gone and the server starts sending boot files again.


[2026-10-07 7:48 p.m.] carlfk
amazing - the cm blade at 20 is staying up


[2026-10-07 8:31 p.m.] carlfk
and now 16.


[2026-10-07 8:32 p.m.] carlfk
none of the Pi v3 or v4 Arty kits.  just the 2 blades


[2026-10-07 8:45 p.m.] carlfk
03 booted from an SD card but PoE power and is solid, so hard to say it is a power problem


[2026-10-07 10:25 p.m.] mithro_
@carlfk - What is the state of the arty boards at ps1?


[2026-10-07 10:26 p.m.] mithro_
@carlfk - Are you still at PS1?


[2026-10-07 10:26 p.m.] carlfk
I am not there yet, but just finished liuch so now I am getting ready to go


[2026-10-07 10:27 p.m.] carlfk
state: nmap shows 22 open on 7 9 16 20.    3 too, but that doesn't count as it is booted from a stock SD RaspiOS


[2026-10-07 10:28 p.m.] carlfk
If I power cycle  7 9 16 20 I expectr them to reboot a few 100 times and the maybe stay booted


[2026-10-07 10:28 p.m.] carlfk
I have no idea why that happens


[2026-10-07 10:29 p.m.] carlfk
oh hey, 7 and 9 just went away.  just 16 and 20  now.


[2026-10-07 10:29 p.m.] carlfk
summery: big mess


[2026-10-07 11:18 p.m.] carlfk
on my way - eta 15m


[2026-10-08 12:15 a.m.] carlfk
I have arrived.


[2026-10-08 1:49 a.m.] carlfk
Make it stop rebooting!!!


[2026-10-08 1:50 a.m.] carlfk
SD card fine.  pull SD and let ti netboot,  loop forever


[2026-10-08 4:59 a.m.] carlfk
@Tim 'mithro' Ansell I am at ps1.  about done here.  did you want me to check on anything


[2026-10-08 5:19 a.m.] carlfk
leaving ps1 heading home. probably back in 18 hours.


[2026-10-08 10:44 p.m.] carlfk
the 4 blade pis are up, and one pi:  Raspberry Pi 3 Model B Plus Rev 1.3pi@pi7


[2026-10-09 9:51 p.m.] mithro_
What does the RPi 3b+ have?


[2026-10-09 9:52 p.m.] carlfk
hjave?  like it hse the cheep POE dongle?


[2026-10-09 9:56 p.m.] mithro_
@carlfk - No FPGA wise - an arty?


[2026-10-09 9:57 p.m.] carlfk
yes arty


[2026-10-09 9:58 p.m.] carlfk
I swapped x86 server, rebuild the os/stuff.  didn't really touch the switch/cables/pi setup -


[2026-10-09 9:59 p.m.] mithro_
@carlfk - I'm still not happy with the instructions the AI has written for you - https://ten64.welland.mithis.com/~tim/ps1-compute-blades-copy24-Letter.pdf


[2026-10-09 9:59 p.m.] carlfk
and regardless I don't understand how what is happening is possible


[2026-10-09 10:00 p.m.] carlfk
I skimmed that - I dont think that will help wiht the current reboot almost forever problem


[2026-10-09 10:01 p.m.] mithro_
@carlfk - I have not been looking at the reboot almost forever problem. Did you want me to look into that?


[2026-10-09 10:04 p.m.] carlfk
yes


[2026-10-09 10:05 p.m.] carlfk
I am about to faf around with https://github.com/systemd/python-systemd#usage to try and get a clue from journalctl --file=/var/log/journal/remote/remote-10.21.0.103.journal

{Embed}
https://github.com/systemd/python-systemd
GitHub - systemd/python-systemd: Python wrappers for systemd functi...
Python wrappers for systemd functionality. Contribute to systemd/python-systemd development by creating an account on GitHub.
2026-10_media/python-systemd-29C0E


[2026-10-09 10:06 p.m.] carlfk
which is the system logs from 10.21.0.103


[2026-10-09 10:07 p.m.] carlfk
all the pi have power.  I have no idea why onlye some of them dont log


[2026-10-09 10:43 p.m.] carlfk
> j = journal.Reader(files=["/var/log/journal/remote/remote-10.21.0.103.journal"])


[2026-10-09 10:43 p.m.] carlfk
print(entry['MESSAGE'])


[2026-10-09 10:43 p.m.] carlfk
unit_file_build_name_map: normal unit file: /usr/lib/systemd/system/poweroff.target


[2026-10-09 10:44 p.m.] carlfk
poweroff is specious :p


[2026-10-10 1:58 a.m.] carlfk
.get_previous() looks useful


[2026-10-22 8:10 a.m.] carlfk
@Tim 'mithro' Ansell are you / claud logged into ps1 box?  someone is.  I'm trying to test _netdev things


[2026-10-22 10:41 p.m.] mithro_
I don't think so?


[2026-10-22 10:56 p.m.] carlfk
huh.  something was doing stuff. didn't look human.  shrug.


[2026-10-22 10:57 p.m.] carlfk
@Tim 'mithro' Ansell do you have code to detect if the pi has a camera?  like the blades don't so the systemd cam.service thrashes and fills up the logs


[2026-10-24 2:59 p.m.] carlfk
ssh -p 10322 pi@ps1.fpgas.online   it happened again.  pop in and see the bash history


[2026-10-24 3:00 p.m.] carlfk
I'm wondering if someone elses AI is .. AIing around


[2026-10-25 12:18 a.m.] carlfk
https://paste.debian.net/hidden/73216aa6   bash_history


==============================================================
Exported 98 message(s)
==============================================================